Mobile terminal and method of controlling the same

ABSTRACT

A mobile terminal is provided that includes a wireless communication unit, a display unit and a controller. The display unit is configured to display a first content including one or more constituent units that contain at least one respective semantic component. The controller is configured to analyze the one or more constituent units and respective semantic components. The controller is further configured to display icons corresponding to the respective constituent units of the first content. The controller is also configured display text related to the content on the display unit responsive to a touch input applied to an icon from among the icons corresponding to the respective constituent units of the first content.

CROSS-REFERENCE TO RELATED APPLICATION

Pursuant to 35 U.S.C. § 119(a), this application claims the benefit ofearlier filing date and right of priority to Korean Application No.10-2013-0056663, filed on May 20, 2013, the contents of which isincorporated by reference herein in its entirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a mobile terminal including a displayunit in which information is input by applying a touch input.

2. Background of the Invention

A terminal is broadly categorized by mobility into a mobile terminal anda stationary terminal. The mobile terminal is further categorized byportability into a handheld terminal and a vehicle-mounted terminal.

In response to an increasing demand for diversified functions, theterminal functions as a multimedia player with multiple functions suchas shooting a photographic object as a still image or moving images,reproducing digital audio and video compression files, playing a game,receiving a broadcast or the like. Furthermore, structural and softwaremodifications to the mobile terminal are considered for supporting andimproving functions of the mobile terminal.

In recent years, functions have been realized that enable a user toinput information by applying a touch input to a display unit and storethe information as various types such as an image, text, or the like.

The user can input data related to content, such as when a response ismade to a text message that is received from an external terminal.However, there is inconvenience in that the same data is repeatedlyinput due to a user's usage pattern of the mobile terminal, in whichcase similar data has to be input repeatedly.

SUMMARY OF THE INVENTION

Therefore, an aspect of the detailed description is to provide a mobileterminal equipped with a display unit in which information isconveniently input by applying a touch input.

To achieve these and other advantages and in accordance with the purposeof this specification, as embodied and broadly described herein, thereis provided a mobile terminal including a display unit to which contentis output, an analysis unit that analyzes constituent units that make upthe content, and a controller that outputs an icon corresponding to theconstituent unit of the content, and controls the display unit in such amanner that text related to the content is output, based on a touchinput that is applied to the icon.

In the mobile terminal, the content may include at least one semanticcomponent, and when the touch input is applied to the icon, thecontroller may output text related to the semantic component.

The mobile terminal may further include a wireless communication unitthat receives the content from an external terminal, and a memory inwhich data that is transmitted to and received from the externalterminal is stored, in which the controller extracts the text related tothe content from the data.

In the mobile terminal, the icon may include multiple graphic images,each including different information, and the controller may generateconstituent elements that make up the text, based on the touch inputthat is applied to the graphic image, and may control the display unitin such a manner that the generated constituent elements are output.

In the mobile terminal, the graphic image may include multiple pieces ofinformation, and the controller may output the multiple pieces ofinformation, based on the touch input that is applied to the graphicimage and may control the display unit in such a manner that among themultiple pieces of information, at least one piece of information isoutput as text.

In the mobile terminal, the controller may execute a function ofsearching for information related to the content, based on the touchinput that is applied to the graphic image, and may control the displayunit in such a manner that the searched-for information is output.

In the mobile terminal, the icon may include an information windowincluding information that is to be searched for, and the controller maycontrol the display unit in such a manner that among the informationthat is to be searched for and the searched-for information, at least atleast one piece of information is output.

In the mobile terminal, the controller may search for a current statusof the mobile terminal, based on the touch input that is applied to theinformation window and may control the display unit in such a mannerthat the searched-for current status is output.

The mobile terminal may further include a memory in which data that isreceived from the external terminal or is input by a user, in which thecontroller may extract information from the memory, based on the touchinput that is applied to the information window.

In the mobile terminal, the controller may control the display unit insuch a manner that an execution screen of an application that includesinformation related to content is output, and may control the displayunit in such a manner that the text is output based on the touch inputthat is applied to the execution screen.

In the mobile terminal, the controller may control the display unit insuch a manner that an arrangement of constituent elements, eachcorresponding to the graphic image, is changed based on a method ofarranging the graphic images or based on order of application of thetouch input to the graphic image.

In the mobile terminal, the controller may control the display unit insuch a manner that an image associated with the text is output, based onthe touch input that is applied to the text.

In the mobile terminal, the icon may include the graphic image includingdifferent text in the same category, and the different text maycorrespond to a response to the content.

In the mobile terminal, the different text may be information related toan emotional expression with respect to the content.

In the mobile terminal, a closing constituent unit of the text may begenerated based on constituent elements of the content.

In the mobile terminal, the content may include an image, and thecontroller may control the display unit in such a manner that among animage and text that are related to information corresponding to theimage included in the content, at least one is output.

In the mobile terminal, the controller may control the mobile terminalin such a manner that an image including information related to thecontent is output.

In the mobile terminal, the controller may limit outputting of aconstituent element of the text that corresponds to the icon, based onthe touch input that is additionally applied to the icon.

To achieve these and other advantages and in accordance with the purposeof this specification, as embodied and broadly described herein, thereis provided a method of controlling a mobile terminal, includingoutputting content to a display unit, analyzing the content, outputtingan icon including information corresponding to the content, andoutputting the information as text, based on a touch input that isapplied to the icon.

In the method, the icon may include multiple graphic images, eachcorresponding to the constituent element that makes up the text.

According to the present invention, the user can easily inputinformation through the use of the icon that includes each text providedusing the content included in the screen information.

In addition, the text is output that is made from one sentence thatcorresponds to the sentence structure as a result of analyzing thesentence structure of the text. Thus, the text that is more naturallysentence-structured is output.

Further scope of applicability of the present application will becomemore apparent from the detailed description given hereinafter. However,it should be understood that the detailed description and specificexamples, while indicating preferred embodiments of the disclosure, aregiven by way of illustration only, since various changes andmodifications within the spirit and scope of the disclosure will becomeapparent to those skilled in the art from the detailed description.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the disclosure and are incorporated in and constitute apart of this specification, illustrate exemplary embodiments andtogether with the description serve to explain the principles of thedisclosure.

In the drawings:

FIG. 1 is a block diagram illustrating a mobile terminal according toone embodiment described in the present disclosure;

FIG. 2A and FIG. 2B are diagrams, each illustrating a telecommunicationsystem in which the mobile terminal according to the present inventionoperates;

FIG. 3A is a perspective diagram illustrating the mobile terminalaccording to one embodiment of the present invention when viewed fromthe front, and FIG. 3B is a perspective diagram illustrating the mobileterminal in FIG. 3A when viewed from the rear;

FIG. 4 is a flowchart illustrating a control method of the mobileterminal according to one embodiment of the present invention;

FIGS. 5(a) to 5(d) are diagrams illustrating the control methodaccording to one embodiment in FIG. 4;

FIGS. 6A (a) to 6D(c) are diagrams illustrating a control method ofoutputting text using an icon according to various embodiments;

FIGS. 7(a) to 7(c) are diagrams illustrating a control method ofoutputting text according to another embodiment;

FIGS. 8A(a) to 8G(d) are diagrams illustrating a control method ofoutputting information according to various embodiments;

FIGS. 9A(a) to 9F(d) are diagrams illustrating a control method ofcooperating with a different application using content according tovarious embodiments;

FIGS. 10A(a) to 10E(d) are diagrams illustrating a control method ofanalyzing an image and executing a prediction function;

FIGS. 11(a) to 11(c) are diagrams illustrating a control method ofproviding an icon including multiple graphic images; and

FIGS. 12A(a) to 12A(c) and FIGS. 12B(a) to 12B(d) are diagrams fordescribing a control method of outputting multiple graphic images eachof which corresponds to content and is included in the same category.

DETAILED DESCRIPTION OF THE INVENTION

Description will now be given in detail of the exemplary embodiments,with reference to the accompanying drawings. For the sake of briefdescription with reference to the drawings, the same or equivalentcomponents will be provided with the same reference numbers, anddescription thereof will not be repeated. A suffix “module” or “unit”used for constituent elements disclosed in the following description ismerely intended for easy description of the specification, and thesuffix itself does not give any special meaning or function. Indescribing the present invention, if a detailed explanation for arelated known function or construction is considered to unnecessarilydivert the gist of the present disclosure, such explanation has beenomitted but would be understood by those skilled in the art. Theaccompanying drawings are used to help easily understood the technicalidea of the present invention and it should be understood that the ideaof the present disclosure is not limited by the accompanying drawings.

A terminal in the present description may include a mobile terminal suchas a portable phone, a smart phone, a notebook computer, a digitalbroadcasting terminal, Personal Digital Assistants (PDA), PortableMultimedia Player (PMP), a navigation system, a slate PC, a tablet PCand an ultra book. However, it will be obvious to those skilled in theart that the present invention may be also applicable to a fixedterminal such as a digital TV and a desktop computer, except forspecific configurations for mobility.

FIG. 1 is a block diagram of a mobile terminal 100 in accordance withone exemplary embodiment. The mobile terminal 100 may comprisecomponents, such as a wireless communication unit 110, an Audio/Video(A/V) input unit 120, a user input unit 130, a sensing unit 140, anoutput unit 150, a memory 160, an interface unit 170, a controller 180,a power supply 190 and the like. FIG. 1 shows the mobile terminal 100having various components, but implementing all of the illustratedcomponents is not a requirement. Greater or fewer components mayalternatively be implemented.

Hereinafter, each component is described in sequence. The wirelesscommunication unit 110 may typically include one or more modules whichpermit wireless communications between the mobile terminal 100 and awireless communication system or between the mobile terminal 100 and anetwork within which the mobile terminal 100 is located. For example,the wireless communication unit 110 may include at least one of abroadcast receiving module 111, a mobile communication module 112, awireless Internet module 113, a short-range communication module 114, alocation information module 115 and the like.

The broadcast receiving module 111 receives a broadcast signal and/orbroadcast associated information from an external broadcast managingentity via a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrialchannel. The broadcast managing entity may indicate a server whichgenerates and transmits a broadcast signal and/or broadcast associatedinformation or a server which receives a pre-generated broadcast signaland/or broadcast associated information and sends them to the displaydevice. The broadcast signal may be implemented as a TV broadcastsignal, a radio broadcast signal, and a data broadcast signal, amongothers. The broadcast signal may further include a data broadcast signalcombined with a TV or radio broadcast signal.

Examples of broadcast associated information include informationassociated with a broadcast channel, a broadcast program, a broadcastservice provider, and the like. The broadcast associated information maybe provided via a mobile communication network, and received by themobile communication module 112.

The broadcast associated information can be implemented in variousformats. For instance, broadcast associated information may includeElectronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB),Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld(DVB-H), and the like.

The broadcast receiving module 111 may be configured to receive digitalbroadcast signals transmitted from various types of broadcast systems.Such broadcast systems may include Digital MultimediaBroadcasting-Terrestrial (DMB-T), Digital MultimediaBroadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO),Digital Video Broadcast-Handheld (DVB-H), Integrated Services DigitalBroadcast-Terrestrial (ISDB-T) and the like. The broadcast receivingmodule 111 may be configured to be suitable for every broadcast systemtransmitting broadcast signals as well as the digital broadcastingsystems.

Broadcast signals and/or broadcast associated information received viathe broadcast receiving module 111 may be stored in a suitable device,such as a memory 160.

The mobile communication module 112 transmits/receives wireless signalsto/from at least one of network entities (e.g., base station, anexternal display device, a server, etc.) on a mobile communicationnetwork. Here, the wireless signals may include audio call signal, video(telephony) call signal, or various formats of data according totransmission/reception of text/multimedia messages.

The mobile communication module 112 may implement a video call mode anda voice call mode. The video call mode indicates a state of calling withwatching a callee's image. The voice call mode indicates a state ofcalling without watching the callee's image. The wireless communicationmodule 112 may transmit and receive at least one of voice and image inorder to implement the video call mode and the voice call mode.

The wireless Internet module 113 supports wireless Internet access forthe display device. This module may be internally or externally coupledto the mobile terminal 100. Examples of such wireless Internet accessmay include Wireless LAN (WLAN) (Wi-Fi), Wireless Broadband (Wibro),Worldwide Interoperability for Microwave Access (Wimax), High SpeedDownlink Packet Access (HSDPA) and the like.

The short-range communication module 114 denotes a module forshort-range communications. Suitable technologies for implementing thismodule may include BLUETOOTH™, Radio Frequency IDentification (RFID),Infrared Data Association (IrDA), Ultra-WideBand (UWB), ZigBee™, NearField Communication (NFC) and the like.

The location information module 115 denotes a module for detecting orcalculating a position of a display device. An example of the locationinformation module 115 may include a Global Position System (GPS)module.

Still referring to FIG. 1, the A/V input unit 120 is configured toprovide audio or video signal input to the display device. The A/V inputunit 120 may include a camera 121 and a microphone 122. The camera 121receives and processes image frames of still pictures or video obtainedby image sensors in a video call mode or a capturing mode. The processedimage frames may be displayed on a display unit 151.

The image frames processed by the camera 121 may be stored in the memory160 or transmitted to the exterior via the wireless communication unit110. Also, user's position information and the like may be calculatedfrom the image frames acquired by the camera 121. Two or more cameras121 may be provided according to the configuration of the displaydevice.

The microphone 122 may receive an external audio signal while thedisplay device is in a particular mode, such as a phone call mode, arecording mode, a voice recognition mode, or the like. This audio signalis processed into digital data. The processed digital data is convertedfor output into a format transmittable to a mobile communication basestation via the mobile communication module 112 in case of the phonecall mode. The microphone 122 may include assorted noise removingalgorithms to remove noise generated in the course of receiving theexternal audio signal.

The user input unit 130 may generate input data input by a user tocontrol the operation of the display device. The user input unit 130 mayinclude a keypad, a dome switch, a touchpad (e.g., staticpressure/capacitance), a jog wheel, a jog switch and the like.

The sensing unit 140 provides status measurements of various aspects ofthe display device. For instance, the sensing unit 140 may detect anopen/close status of the display device, a change in a location of themobile terminal 100, a presence or absence of user contact with themobile terminal 100, the location of the mobile terminal 100,acceleration/deceleration of the mobile terminal 100, and the like, soas to generate a sensing signal for controlling the operation of themobile terminal 100. For example, regarding a slide-type display device,the sensing unit 140 may sense whether a sliding portion of the displaydevice is open or closed. Other examples include sensing functions, suchas the sensing unit 140 sensing the presence or absence of powerprovided by the power supply 190, the presence or absence of a couplingor other connection between the interface unit 170 and an externaldevice.

The output unit 150 is configured to output an audio signal, a videosignal or a tactile signal. The output unit 150 may include a displayunit 151, an audio output module 152, an alarm unit 153 and a hapticmodule 154.

The display unit 151 may output information processed in the mobileterminal 100. For example, when the display device is operating in aphone call mode, the display unit 151 will provide a User Interface (UI)or a Graphic User Interface (GUI), which includes information associatedwith the call. As another example, if the display device is in a videocall mode or a capturing mode, the display unit 151 may additionally oralternatively display images captured and/or received, UI, or GUI.

The display unit 151 may be implemented using, for example, at least oneof a Liquid Crystal Display (LCD), a Thin Film Transistor-Liquid CrystalDisplay (TFT-LCD), an Organic Light-Emitting Diode (OLED), a flexibledisplay, a three-dimensional (3D) display, an e-ink display or the like.

Some of such displays 151 may be implemented as a transparent type or anoptical transparent type through which the exterior is visible, which isreferred to as ‘transparent display’. A representative example of thetransparent display may include a Transparent OLED (TOLED), and thelike. The rear surface of the display unit 151 may also be implementedto be optically transparent. Under this configuration, a user can viewan object positioned at a rear side of a terminal body through a regionoccupied by the display unit 151 of the terminal body.

The display unit 151 may be implemented in two or more in numberaccording to a configured aspect of the mobile terminal 100. Forinstance, a plurality of the displays 151 may be arranged on one surfaceto be spaced apart from or integrated with each other, or may bearranged on different surfaces.

The display unit 151 may also be implemented as a stereoscopic displayunit for displaying stereoscopic images.

Here, the stereoscopic image may be a three-dimensional (3D)stereoscopic image, and the 3D stereoscopic image is an image refers toan image making a viewer feel that a gradual depth and reality of anobject on a monitor or a screen is the same as a reality space. A 3Dstereoscopic image is implemented by using binocular disparity.Binocular disparity refers to disparity made by the positions of twoeyes. When two eyes view different 2D images, the images are transferredto the brain through the retina and combined in the brain to provide theperception of depth and reality sense.

The stereoscopic display unit may employ a stereoscopic display schemesuch as stereoscopic scheme (a glass scheme), an auto-stereoscopicscheme (glassless scheme), a projection scheme (holographic scheme), orthe like. Stereoscopic schemes commonly used for home televisionreceivers, or the like, include Wheatstone stereoscopic scheme, or thelike.

The auto-stereoscopic scheme includes, for example, a parallax barrierscheme, a lenticular scheme, an integral imaging scheme, or the like.The projection scheme includes a reflective holographic scheme, atransmissive holographic scheme, or the like.

In general, a 3D stereoscopic image includes a left image (a left eyeimage) and a right image (a right eye image). According to how left andright images are combined into a 3D stereoscopic image, the 3Dstereoscopic imaging method is divided into a top-down method in whichleft and right images are disposed up and down in a frame, an L-to-R(left-to-right, side by side) method in which left and right images aredisposed left and right in a frame, a checker board method in whichfragments of left and right images are disposed in a tile form, aninterlaced method in which left and right images are alternatelydisposed by columns and rows, and a time sequential (or frame by frame)method in which left and right images are alternately displayed by time.

Also, as for a 3D thumbnail image, a left image thumbnail and a rightimage thumbnail are generated from a left image and a right image of theoriginal image frame, respectively, and then combined to generate asingle 3D thumbnail image. In general, thumbnail refers to a reducedimage or a reduced still image. The thusly generated left imagethumbnail and the right image thumbnail are displayed with a horizontaldistance difference therebetween by a depth corresponding to thedisparity between the left image and the right image on the screen,providing a stereoscopic space sense.

A left image and a right image required for implementing a 3Dstereoscopic image is displayed on the stereoscopic display unit by astereoscopic processing unit. The stereoscopic processing unit mayreceive the 3D image and extract the left image and the right image, ormay receive the 2D image and change it into a left image and a rightimage.

Here, if the display unit 151 and a touch sensitive sensor (referred toas a touch sensor) have a layered structure therebetween (referred to asa ‘touch screen’), the display unit 151 may be used as an input deviceas well as an output device. The touch sensor may be implemented as atouch film, a touch sheet, a touchpad, and the like.

The touch sensor may be configured to convert changes of a pressureapplied to a specific part of the display unit 151, or a capacitanceoccurring from a specific part of the display unit 151, into electricinput signals. Also, the touch sensor may be configured to sense notonly a touched position and a touched area, but also touch pressure.Here, a touch object is an object to apply a touch input onto the touchsensor. Examples of the touch object may include a finger, a touch pen,a stylus pen, a pointer or the like.

When touch inputs are sensed by the touch sensors, corresponding signalsare transmitted to a touch controller. The touch controller processesthe received signals, and then transmits corresponding data to thecontroller 180. Accordingly, the controller 180 may sense which regionof the display unit 151 has been touched.

Still referring to FIG. 1, a proximity sensor 141 may be arranged at aninner region of the mobile terminal 100 covered by the touch screen, ornear the touch screen. The proximity sensor 141 may be provided as oneexample of the sensing unit 140. The proximity sensor 141 indicates asensor to sense presence or absence of an object approaching to asurface to be sensed, or an object disposed near a surface to be sensed,by using an electromagnetic field or infrared rays without a mechanicalcontact. The proximity sensor 141 has a longer lifespan and a moreenhanced utility than a contact sensor.

The proximity sensor 141 may include a transmissive type photoelectricsensor, a direct reflective type photoelectric sensor, a mirrorreflective type photoelectric sensor, a high-frequency oscillationproximity sensor, a capacitance type proximity sensor, a magnetic typeproximity sensor, an infrared rays proximity sensor, and so on. When thetouch screen is implemented as a capacitance type, proximity of apointer to the touch screen is sensed by changes of an electromagneticfield. In this case, the touch screen (touch sensor) may be categorizedinto a proximity sensor.

Hereinafter, for the sake of brief explanation, a status that thepointer is positioned to be proximate onto the touch screen withoutcontact will be referred to as ‘proximity touch’, whereas a status thatthe pointer substantially comes in contact with the touch screen will bereferred to as ‘contact touch’. For the position corresponding to theproximity touch of the pointer on the touch screen, such positioncorresponds to a position where the pointer faces perpendicular to thetouch screen upon the proximity touch of the pointer.

The proximity sensor 141 senses proximity touch, and proximity touchpatterns (e.g., distance, direction, speed, time, position, movingstatus, etc.). Information relating to the sensed proximity touch andthe sensed proximity touch patterns may be output onto the touch screen.

When a touch sensor is overlaid on the stereoscopic display unit 152 ina layered manner (hereinafter, referred to as ‘stereoscopic touchscreen’), or when the stereoscopic display unit 152 and a 3D sensorsensing a touch operation are combined, the stereoscopic display unit152 may also be used as a 3D input device.

As examples of the 3D sensor, the sensing unit 140 may include aproximity sensor 141, a stereoscopic touch sensing unit 142, anultrasonic sensing unit 143, and a camera sensing unit 144.

The proximity sensor 141 detects the distance between a sensing object(e.g., the user's finger or a stylus pen) applying a touch by using theforce of electromagnetism or infrared rays without a mechanical contactand a detect surface. By using the distance, the terminal recognizeswhich portion of a stereoscopic image has been touched. In particular,when the touch screen is an electrostatic touch screen, the degree ofproximity of the sensing object is detected based on a change of anelectric field according to proximity of the sensing object, and a touchto the 3D image is recognized by using the degree of proximity.

The stereoscopic touch sensing unit 142 is configured to detect thestrength or duration of a touch applied to the touch screen. Forexample, the stereoscopic touch sensing unit 142 may sense touchpressure. When the pressure is strong, it may recognize the touch as atouch with respect to an object located farther away from the touchscreen toward the inside of the terminal.

The ultrasonic sensing unit 143 is configured to recognize positioninformation of the sensing object by using ultrasonic waves. Theultrasonic sensing unit 143 may include, for example, an optical sensorand a plurality of ultrasonic sensors. The optical sensor is configuredto sense light and the ultrasonic sensors may be configured to senseultrasonic waves. Since light is much faster than ultrasonic waves, atime for which the light reaches the optical sensor is much shorter thana time for which the ultrasonic wave reaches the ultrasonic sensor.Therefore, a position of a wave generation source may be calculated byusing a time difference from the time that the ultrasonic wave reachesbased on the light as a reference signal.

The camera sensing unit 144 includes at least one of a camera 121, aphoto sensor, and a laser sensor. For example, the camera 121 and thelaser sensor may be combined to detect a touch of the sensing objectwith respect to a 3D stereoscopic image. When distance informationdetected by a laser sensor is added to a 2D image captured by thecamera, 3D information can be obtained.

In another example, a photo sensor may be laminated on the displaydevice. The photo sensor is configured to scan a movement of the sensingobject in proximity to the touch screen. In detail, the photo sensorincludes photo diodes and transistors at rows and columns to scancontent mounted on the photo sensor by using an electrical signalchanging according to the quantity of applied light. Namely, the photosensor calculates the coordinates of the sensing object according tovariation of light to thus obtain position information of the sensingobject.

The audio output module 152 may convert and output as sound audio datareceived from the wireless communication unit 110 or stored in thememory 160 in a call signal reception mode, a call mode, a record mode,a voice recognition mode, a broadcast reception mode, and the like.Also, the audio output module 152 may provide audible outputs related toa particular function performed by the mobile terminal 100 (e.g., a callsignal reception sound, a message reception sound, etc.). The audiooutput module 152 may include a speaker, a buzzer or the like.

The alarm unit 153 outputs a signal for informing about an occurrence ofan event of the mobile terminal 100. Events generated in the displaydevice may include call signal reception, message reception, key signalinputs, a touch input etc. In addition to video or audio signals, thealarm unit 153 may output signals in a different manner, for example,using vibration to inform about an occurrence of an event. The video oraudio signals may be also outputted via the audio output module 152, sothe display unit 151 and the audio output module 152 may be classifiedas parts of the alarm unit 153.

A haptic module 154 generates various tactile effects the user may feel.A typical example of the tactile effects generated by the haptic module154 is vibration. The strength and pattern of the haptic module 154 canbe controlled. For example, different vibrations may be combined to beoutputted or sequentially outputted.

Besides vibration, the haptic module 154 may generate various othertactile effects such as an effect by stimulation such as a pinarrangement vertically moving with respect to a contact skin, a sprayforce or suction force of air through a jet orifice or a suctionopening, a contact on the skin, a contact of an electrode, electrostaticforce, etc., an effect by reproducing the sense of cold and warmth usingan element that can absorb or generate heat.

The haptic module 154 may be implemented to allow the user to feel atactile effect through a muscle sensation such as fingers or arm of theuser, as well as transferring the tactile effect through a directcontact. Two or more haptic modules 154 may be provided according to theconfiguration of the mobile terminal 100.

The memory 160 may store software programs used for the processing andcontrolling operations performed by the controller 180, or maytemporarily store data (e.g., a phonebook, messages, still images,video, etc.) that are inputted or outputted. In addition, the memory 160may store data regarding various patterns of vibrations and audiosignals outputted when a touch is inputted to the touch screen.

The memory 160 may include at least one type of storage medium includinga Flash memory, a hard disk, a multimedia card micro type, a card-typememory (e.g., SD or DX memory, etc), a Random Access Memory (RAM), aStatic Random Access Memory (SRAM), a Read-Only Memory (ROM), anElectrically Erasable Programmable Read-Only Memory (EEPROM), aProgrammable Read-Only memory (PROM), a magnetic memory, a magneticdisk, and an optical disk. Also, the mobile terminal 100 may be operatedin relation to a web storage device that performs the storage functionof the memory 160 over the Internet.

The interface unit 170 serves as an interface with every external deviceconnected with the mobile terminal 100. For example, the externaldevices may transmit data to an external device, receives and transmitspower to each element of the mobile terminal 100, or transmits internaldata of the mobile terminal 100 to an external device. For example, theinterface unit 170 may include wired or wireless headset ports, externalpower supply ports, wired or wireless data ports, memory card ports,ports for connecting a device having an identification module, audioinput/output (I/O) ports, video I/O ports, earphone ports, or the like.

The identification module may be a chip that stores various informationfor authenticating the authority of using the mobile terminal 100 andmay include a user identity module (UIM), a subscriber identity module(SIM) a universal subscriber identity module (USIM), and the like. Inaddition, the device having the identification module (referred to as‘identifying device’, hereinafter) may take the form of a smart card.Accordingly, the identifying device may be connected with the terminal100 via the interface unit 170.

When the mobile terminal 100 is connected with an external cradle, theinterface unit 170 may serve as a passage to allow power from the cradleto be supplied therethrough to the mobile terminal 100 or may serve as apassage to allow various command signals inputted by the user from thecradle to be transferred to the display device therethrough. Variouscommand signals or power inputted from the cradle may operate as signalsfor recognizing that the display device is properly mounted on thecradle.

The controller 180 typically controls the general operations of thedisplay device. For example, the controller 180 performs controlling andprocessing associated with voice calls, data communications, videocalls, and the like. The controller 180 may include a multimedia module181 for reproducing multimedia data. The multimedia module 181 may beconfigured within the controller 180 or may be configured to beseparated from the controller 180.

The controller 180 may perform a pattern recognition processing torecognize a handwriting input or a picture drawing input performed onthe touch screen as characters or images, respectively. Also, thecontroller 180 may execute a lock state to restrict a user frominputting control commands for applications when a state of the displaydevice meets a preset condition. Also, the controller 180 may control alock screen displayed in the lock state based on a touch input sensed onthe display unit 151 in the lock state of the display device.

The power supply unit 190 receives external power or internal power andsupplies appropriate power required for operating respective elementsand components under the control of the controller 180.

Various embodiments described herein may be implemented in acomputer-readable or its similar medium using, for example, software,hardware, or any combination thereof.

For a hardware implementation, the embodiments described herein may beimplemented by using at least one of application specific integratedcircuits (ASICs), digital signal processors (DSPs), digital signalprocessing devices (DSPDs), programmable logic devices (PLDs), fieldprogrammable gate arrays (FPGAs), processors, controllers,micro-controllers, microprocessors, electronic units designed to performthe functions described herein. In some cases, such embodiments may beimplemented by the controller 180 itself.

For a software implementation, the embodiments such as procedures orfunctions described herein may be implemented by separate softwaremodules. Each software module may perform one or more functions oroperations described herein. Software codes can be implemented by asoftware application written in any suitable programming language. Thesoftware codes may be stored in the memory 160 and executed by thecontroller 180.

Hereinafter, a communication system which is operable with the mobileterminal 100 according to the present invention will be described. FIGS.2A and 2B are conceptual views of a communication system operable with amobile terminal 100 in accordance with the present disclosure.

First, referring to FIG. 2A, such communication systems utilizedifferent air interfaces and/or physical layers. Examples of such airinterfaces utilized by the communication systems include FrequencyDivision Multiple Access (FDMA), Time Division Multiple Access (TDMA),Code Division Multiple Access (CDMA), and Universal MobileTelecommunications System (UMTS), the Long Term Evolution (LTE) of theUMTS, the Global System for Mobile Communications (GSM), and the like.

By way of non-limiting example only, further description will relate toa CDMA communication system, but such teachings apply equally to othersystem types including the CDMA wireless communication system.

Referring now to FIG. 2A, a CDMA wireless communication system is shownhaving a plurality of display device s 100, a plurality of base stations(BSs) 270, base station controllers (BSCs) 275, and a mobile switchingcenter (MSC) 280. The MSC 280 is configured to interface with aconventional Public Switch Telephone Network (PSTN) 290. The MSC 280 isalso configured to interface with the BSCs 275. The BSCs 275 are coupledto the base stations 270 via backhaul lines. The backhaul lines may beconfigured in accordance with any of several known interfaces including,for example, E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL.Hence, the plurality of BSCs 275 can be included in the system as shownin FIG. 2A.

Each base station 270 may include one or more sectors, each sectorhaving an omni-directional antenna or an antenna pointed in a particulardirection radially away from the base station 270. Alternatively, eachsector may include two or more different antennas. Each base station 270may be configured to support a plurality of frequency assignments, witheach frequency assignment having a particular spectrum (e.g., 1.25 MHz,5 MHz, etc.).

The intersection of sector and frequency assignment may be referred toas a CDMA channel. The base stations 270 may also be referred to as BaseStation Transceiver Subsystems (BTSs). In some cases, the term “basestation” may be used to refer collectively to a BSC 275, and one or morebase stations 270. The base stations may also be denoted as “cellsites.” Alternatively, individual sectors of a given base station 270may be referred to as cell sites.

A broadcasting transmitter (BT) 295, as shown in FIG. 2A, transmits abroadcast signal to the display device s 100 operating within thesystem. The broadcast receiving module 111 (FIG. 1B) is typicallyconfigured inside the mobile terminal 100 to receive broadcast signalstransmitted by the BT 295.

FIG. 2A further depicts several Global Positioning System (GPS)satellites 300. Such satellites 300 facilitate locating the position ofat least one of plural display devices 100. Two satellites are depictedin FIG. 2, but it is understood that useful position information may beobtained with greater or fewer satellites than two satellites. The GPSmodule is typically configured to cooperate with the satellites 300 toobtain desired position information. It is to be appreciated that othertypes of position detection technology, (i.e., location technology thatmay be used in addition to or instead of GPS location technology) mayalternatively be implemented. If desired, at least one of the GPSsatellites 300 may alternatively or additionally be configured toprovide satellite DMB transmissions.

During typical operation of the wireless communication system, the basestations 270 receive sets of reverse-link signals from various displaydevices 100. The display devices 100 are engaging in calls, messaging,and executing other communications. Each reverse-link signal received bya given base station 270 is processed within that base station 270. Theresulting data is forwarded to an associated BSC 275. The BSC 275provides call resource allocation and mobility management functionalityincluding the orchestration of soft handoffs between base stations 270.The BSCs 275 also route the received data to the MSC 280, which thenprovides additional routing services for interfacing with the PSTN 290.Similarly, the PSTN 290 interfaces with the MSC 280, and the MSC 280interfaces with the BSCs 275, which in turn control the base stations270 to transmit sets of forward-link signals to the display device s100.

Hereinafter, description will be given of a method for acquiringlocation information of a display device using a wireless fidelity(WiFi) positioning system (WPS), with reference to FIG. 2B.

The WiFi positioning system (WPS) 300 refers to a location determinationtechnology based on a wireless local area network (WLAN) using WiFi as atechnology for tracking the location of the mobile terminal 100 using aWiFi module provided in the mobile terminal 100 and a wireless accesspoint 320 for transmitting and receiving to and from the WiFi module.

The WiFi positioning system 300 may include a WiFi locationdetermination server 310, a mobile terminal 100, a wireless access point(AP) 320 connected to the mobile terminal 100, and a database 330 storedwith any wireless AP information.

The WiFi location determination server 310 extracts the information ofthe wireless AP 320 connected to the mobile terminal 100 based on alocation information request message (or signal) of the mobile terminal100. The information of the wireless AP 320 may be transmitted to theWiFi location determination server 310 through the mobile terminal 100or transmitted to the WiFi location determination server 310 from thewireless AP 320.

The information of the wireless AP extracted based on the locationinformation request message of the mobile terminal 100 may be at leastone of MAC address, SSID, RSSI, channel information, privacy, networktype, signal strength and noise strength.

The WiFi location determination server 310 receives the information ofthe wireless AP 320 connected to the mobile terminal 100 as describedabove, and compares the received wireless AP 320 information withinformation contained in the pre-established database 330 to extract (oranalyze) the location information of the mobile terminal 100.

On the other hand, referring to FIG. 2B, as an example, the wireless APconnected to the mobile terminal 100 is illustrated as a first, asecond, and a third wireless AP 320. However, the number of wireless APsconnected to the mobile terminal 100 may be changed in various waysaccording to a wireless communication environment in which the mobileterminal 100 is located. When the mobile terminal 100 is connected to atleast one of wireless APs, the WiFi positioning system 300 can track thelocation of the mobile terminal 100.

Next, considering the database 330 stored with any wireless APinformation in more detail, various information of any wireless APsdisposed at different locations may be stored in the database 330. Theinformation of any wireless APs stored in the database 330 may beinformation such as MAC address, SSID, RSSI, channel information,privacy, network type, latitude and longitude coordinate, building atwhich the wireless AP is located, floor number, detailed indoor locationinformation (GPS coordinate available), AP owner's address, phonenumber, and the like.

In this manner, any wireless AP information and location informationcorresponding to the any wireless AP are stored together in the database330, and thus the WiFi location determination server 310 may retrievewireless AP information corresponding to the information of the wirelessAP 320 connected to the mobile terminal 100 from the database 330 toextract the location information matched to the searched wireless AP,thereby extracting the location information of the mobile terminal 100.

Furthermore, the extracted location information of the mobile terminal100 may be transmitted to the mobile terminal 100 through the WiFilocation determination server 310, thereby acquiring the locationinformation of the mobile terminal 100.

FIG. 3A is a front perspective view illustrating an example of themobile terminal 100 associated with the present disclosure. The mobileterminal 100 disclosed herein is provided with a bar-type terminal body.However, the present invention is not limited to this, but is alsoapplicable to various structures such as watch type, clip type, glassestype or folder type, flip type, swing type, swivel type, or the like, inwhich two and more bodies are combined with each other in a relativelymovable manner.

The body includes a case (casing, housing, cover, etc.) forming theappearance of the terminal. In this embodiment, the case may be dividedinto a front case 101 and a rear case 102. Various electronic componentsis incorporated into a space formed between the front case 101 and therear case 102. At least one middle case may be additionally disposedbetween the front case 101 and the rear case 102, and a battery cover103 for covering the battery 191 may be detachably configured at therear case 102. The cases may be formed by injection-molding a syntheticresin or may be also formed of a metal, for example, stainless steel(STS), titanium (Ti), or the like.

A display unit 151, a first audio output module 153 a, a first camera121 a, a first manipulating unit 131 and the like may be disposed on afront surface of the terminal body, and a microphone 122, an interfaceunit 170, a second manipulating unit 132 and the like may be provided ona lateral surface thereof.

The display unit 151 may be configured to display (output) informationbeing processed in the mobile terminal 100. The display unit 151 mayinclude at least one of a liquid crystal display (LCD), a thin filmtransistor-liquid crystal display (TFT-LCD), an organic light emittingdiode (OLED) display, a flexible display, a 3-dimensional (3D) display,and an e-ink display.

The display unit 151 may include a touch sensing mechanism to receive acontrol command by a touch method. When a touch is made to any one placeon the display unit 151, the touch sensing mechanism may be configuredto sense this touch and enter the content corresponding to the touchedplace. The content entered by a touch method may be a text or numericalvalue, or a menu item capable of indication or designation in variousmodes.

The touch sensing mechanism may be formed with transparency to allowvisual information displayed on the display unit 151 to be seen, and mayinclude a structure for enhancing the visibility of a touch screen atbright places. Referring to FIG. 3A, the display unit 151 occupies amost portion of the front surface of the front case 101.

The first audio output unit 153 a and the first camera 121 a aredisposed in a region adjacent to one of both ends of the display unit151, and the first manipulation input unit 131 and the microphone 122are disposed in a region adjacent to the other end thereof. The secondmanipulation interface 132 (refer to FIG. 3B), the interface 170, andthe like may be disposed on a lateral surface of the terminal body.

The first audio output module 153 a may be a receiver for transferringvoice sounds to the user's ear or a loud speaker for outputting variousalarm sounds or multimedia reproduction sounds. It may be configuredsuch that the sounds generated from the first audio output module 153 aare released along an assembly gap between the structural bodies. Inthis instance, a hole independently formed to output audio sounds is notseen or hidden in terms of appearance, thereby further simplifying theappearance of the mobile terminal 100. However, the present inventionmay not be limited to this, but a hole for releasing the sounds may beformed on the window.

The first camera 121 a processes video frames such as still or movingimages obtained by the image sensor in a video call mode or capturemode. The processed video frames may be displayed on the display unit151.

The user input unit 130 is manipulated to receive a command forcontrolling the operation of the mobile terminal 100. The user inputunit 130 may include a first and a second manipulation unit 131, 132.The first and the second manipulation unit 131, 132 may be commonlyreferred to as a manipulating portion, and any method may be employed ifit is a tactile manner allowing the user to perform manipulation with atactile feeling such as touch, push, scroll or the like.

FIG. 3A illustrates the first manipulation unit 131 is a touch key, butthe present disclosure is not limited to this. For example, the firstmanipulation unit 131 may be configured with a mechanical key, or acombination of a touch key and a mechanical key.

The content received by the first and/or second manipulation units 131,132 may be set in various ways. For example, the first manipulation unit131 may be used to receive a command such as menu, home key, cancel,search, or the like, and the second manipulation unit 132 may receive acommand, such as controlling a volume level being outputted from thefirst audio output module 153 a, or switching into a touch recognitionmode of the display unit 151.

The microphone 122 may be formed to receive the user's voice, othersounds, or the like. The microphone 122 may be provided at a pluralityof places, and configured to receive stereo sounds.

The interface unit 170 serves as a path allowing the mobile terminal 100to exchange data with external devices. For example, the interface unit170 may be at least one of a connection terminal for connecting to anearphone in a wired or wireless manner, a port for near fieldcommunication (for example, an Infrared Data Association (IrDA) port, aBluetooth port, a wireless LAN port, and the like), and a power supplyterminal for supplying power to the mobile terminal 100. The interfaceunit 170 may be implemented in the form of a socket for accommodating anexternal card such as Subscriber Identification Module (SIM) or UserIdentity Module (UIM), and a memory card for information storage.

Next, FIG. 3B is a rear perspective view illustrating mobile terminal100 illustrated in FIG. 3A. Referring to FIG. 3b , a second camera 121 bmay be additionally mounted at a rear surface of the terminal body,namely, the rear case 102. The second camera 121 b has an imagecapturing direction, which is substantially opposite to the direction ofthe first camera unit 121 a (refer to FIG. 3A), and may have a differentnumber of pixels from that of the first camera unit 121 a.

For example, it is preferable that the first camera 121 a has arelatively small number of pixels enough not to cause difficulty whenthe user captures his or her own face and sends it to the other partyduring a video call or the like, and the second camera 121 b has arelatively large number of pixels since the user often captures ageneral object that is not sent immediately. The first and the secondcamera 121 a, 121 b may be provided in the terminal body in a rotatableand popupable manner.

Furthermore, a flash 123 and a mirror 124 may be additionally disposedadjacent to the second camera 121 b. The flash 123 illuminates lighttoward an object when capturing the object with the second camera 121 b.The mirror 124 allows the user to look at his or her own face, or thelike, in a reflected way when capturing himself or herself (in aself-portrait mode) by using the second camera 121 b.

A second audio output unit 153 b may be additionally disposed at a rearsurface of the terminal body. The second audio output unit 153 btogether with the first audio output unit 153 a can implement a stereofunction, and may be also used to implement a speaker phone mode duringa phone call.

An antenna for receiving broadcast signals may be additionally disposedat a lateral surface of the terminal body in addition to an antenna formaking a phone call or the like. The antenna constituting part of thebroadcast receiving module 111 may be provided in the terminal body in aretractable manner.

A power supply unit 190 for supplying power to the mobile terminal 100may be mounted on the terminal body. The power supply unit 190 may beincorporated into the terminal body, or may include a battery 191configured in a detachable manner on the outside of the terminal body.According to the drawing, it is illustrated that the battery cover 103is combined with the rear case 102 to cover the battery 191, therebyrestricting the battery 191 from being released and protecting thebattery 191 from external shocks and foreign substances.

Next, FIG. 4 is a flowchart illustrating a method of controlling themobile terminal according to one embodiment of the present invention andFIGS. 5(a) to 5(d) are diagrams for describing the control method inFIG. 4 according to one embodiment.

Referring to FIG. 4 and FIGS. 5(a) to 5(d), the controller 180 outputsscreen information including at least one piece of content on thedisplay unit 181 (S501). For example, as illustrated in FIG. 5, thescreen information corresponds to an execution screen of a messageapplication that transmits information to an external terminal. However,the screen information is not limited to that screen, but corresponds toan input window into which content (text, an image, a moving image, andthe like) is input based on a control command that is applied to themobile terminal.

The screen information includes at least one piece of content. Thecontent means data that the display unit 151 and the audio output module152 provide to the user, such as text, an image, a reproducible movingimage file, sound data and the like.

Referring to FIG. 5(a), the display unit 151 outputs the executionscreen of the message application. The execution screen includes a nameof a representative name of the external terminal that transmits amessage, the received message, and the like. For example, the screeninformation includes KIM YOUNG SU as the representative name of theexternal terminal and “How will you come here?” as the received message.

The controller analyzes a construction of the content (S502). Thecontroller 180 analyzes a semantic component construction of firstcontent 510, that is, constituent elements that make up a sentence. Forexample, the controller 180 divides the first content 510 into semanticcomponent units and analyzes these. For example, the first content 510is divided into “How” 511, “will you come here” 512, and “?” 513.

The controller 180 controls the display unit 503 so that an iconcorresponding to the first content 510 is output (S503). The controller180 is aware of a meaning of the content and predicts a response to thecontent. For example, the controller predicts a transportation means, atransportation method, a transportation destination, a current location,a time to the destination and so on using a combination of “How” and“will you come here.”

The controller 180 controls the display unit so that details for thepredicted responses are output as icons, based on a touch input that isapplied to the input window for inputting text on the execution screen.

The controller 180 controls the display unit 151 so that the text isoutput, based on the touch input that is applied to the icon (S504). Asillustrated in FIG. 5(b), the controller 180 outputs the display unit151 so that multiple icons 610 to which the touch input is applied areoutput in order to output the text corresponding to the predictedresponse. For example, the multiple icons 610 include an icon forinputting a searched-for current location as text, an icon for inputtingthe public transportation to be used as text, an icon for inputtingroute information as text, and an addition icon for adding an icon forinputting different predicted information.

The controller 180 controls the display unit 151 so that textcorresponding to the icon is output, based on the touch input applied tothe icon. For example, the controller 180 controls the display unit 151so that the text is output to the input window.

For example, the controller 180 controls the display unit 151 so that “Iwill get there” 711 is output to the input window, based on the touchinput that is applied to a public transportation icon.

In addition, the controller 180 controls the display unit 151 so thatletters (a word or a semantic component) corresponding to the analyzedsentence structure of the content 510 are output in order to output aresponse that is sentence-structured, which corresponding to the content510. For example, the controller 180 controls the display unit 151 sothat “by bus” 712 corresponding to “Will you come here” is output,according to the predicted response corresponding to the question.

That is, the controller 180 recognizes a subject, an object, a verb, anadverbial phrase, a predicate and so on of the content that is output tothe display unit, and controls the display unit 151 so that the textcorresponding to the sentence structure of the content are outputaccording to the touch input that is applied to the icon.

In response to “How will you come here?,” the controller 180 controlsthe display unit 151 so that text 710, “I'll get there by bus,” isoutput, based on the touch input that is applied to the icon associatedwith the public transportation. That is, a first constituent unit 711,“I will get there,” corresponds to “How” 511, a second constituent unit712, “by bus,” corresponds to “will you come here” 512, and a thirdconstituent unit 713, “.”, corresponds to “?” 513.

The controller 180 transmits the text to the external terminal, based onthe touch input applied to a transmission icon SEND for transmittingtext that is input into the input window on the input window. That is,the user can easily input information through the use of the icon thatincludes each text provided using the content included in the screeninformation.

In addition, the text is output that is made from one sentence thatcorresponds to the sentence structure as a result of analyzing thesentence structure of the text. Thus, the text that is more naturallysentence-structured is output.

FIGS. 6A(a) to 6D(c) are diagrams for describing a control method ofoutputting the text using an icon according to various embodiments.

An arrangement of constituent elements that make up the text that iscreated based on the touch input that is applied to the icon isdescribed referring to FIGS. 6A(a) to 6A(d). Referring to FIGS. 6A(a)and 6A(b), the display unit 151 includes the screen informationincluding the content 510, and the controller 180 controls the displayunit 151 so that the icon 610 associated with the response correspondingto the analyzed sentence structure of the content 510 is output. Forexample, the icon 610 includes a first image 611 indicating the publictransportation and a second image 612 indicating the current location.The controller 180 controls the display unit 151 so that text 710, madefrom “i'll get there” 711, “by bus” 712, and “.” 713, is output, basedon the touch input that is applied to the first image 611.

Referring to FIGS. 6A(b) and 6A(c), after the touch input is applied tothe first image 611, the controller 180 controls the display unit 151 sothat the constituent unit that corresponds to the second image 612, thatis, “from here” 714, is arranged after “by bus” 711, based on the touchinput applied to the second image 612.

That is, the controller 180 controls the display unit 151 so that thetext including constituent units, which correspond to the touch inputsinput to the icon, respectively, in the order of applying the touchinput, is output. That is, changed text 710 a, “I'll get there by busfrom here” composed in the order of applying the touch input to theicon, is output to the display unit. Accordingly, the user can outputthe text having the desired sentence structure, by sequentially applyingthe touch inputs to the icon.

Referring to FIGS. 6A(b) and 6A(d), the corresponding text is outputbased on the touch inputs applied to the first and second images 611 and612. However, the controller 180 controls the display unit 151 so thatthe text that corresponds to the first and second graphic images 611 and612 in the order of arranging the first and second graphic images 611and 612 is output.

That is, the controller 180 controls the display unit 151 so that “fromhere” 714, the constituent unit corresponding to the second image 612,is arranged before “by bus” 711, the constituent unit corresponding tothe first image 611 and then is output. That is, changed text 710 b,“I'll get there by bus from here,” in which the constituent units arearranged regardless of the order of applying the touch input to theicons, is output to the display unit. That is, even though the userapplies the touch input to the icon corresponding to the text that isdesired to be output without considering the sentence structure, thetext is created according to the arrangement of the icons.

A method of controlling selection of the icon and cancellation of theselection is described referring to FIG. 6B(a) to 6B(d). Referring toFIG. 6B(a), the controller 180 controls the display unit 151 so thattext 720 is output, based on the touch input applied to the multiplegraphic images included in the icon 610. The controller 180 controls thedisplay unit 151 so that the graphic image to which the touch input isapplied is changed and is output. For example, when the touch input isapplied to the graphic image and the sentence construction correspondingto this application of the touch input, the controller 180 controls thedisplay unit 151 so that the graphic image is changed in color, lightand shade, or the like and is output. For example, the text 720, “I goton the bus No. 508 at the GASAN station and is on my way home, but ittakes longer time due to a rain-caused traffic jam” is output based onthe touch input that is applied to the four graphic images.

Referring to FIG. 6B(b), when the touch input is again applied to anyone of the graphic images that are input to which the touch input isapplied, the controller 180 deletes the constituent unit of the textcorresponding to the graphic image and controls the display unit 151 sothat the graphic image is re-changed and is output. That is, thecontroller 180 controls the display unit 151 so that changed text 720,’“I got on the bus No. 508 at the GASAN station and am on my way home,but it will take a longer time due to a traffic jam” is output.

It is apparent to a person of ordinary skill in the art that, based onthe touch input that is again applied to the graphic image, theconstruction of the corresponding text is again output. Accordingly, theuser can easily amend the text by applying the touch input to thegraphic image a number of multiple times. In addition, the selectedimage is changed and is output. Thus, the selected graphic image and theconstituent unit of the text corresponding to the selected graphic imageare recognized.

A method of amending the text by changing the arrangement of themultiple graphic images is described referring to FIGS. 6C(a) and 6C(b).Referring to FIGS. 6C(a) and 6C(b), the first and second graphic images611 and 612 are output in this sequence, and the text 710 b is output as“From here, I'll get there by bus.”

The controller 180 changes the order in which the first and secondgraphic images 611 and 612 are output, by applying the touch input tothe icon 610. For example, the controller 180 controls the display unit151 so that the order in which the first and second graphic images 611and 612 is changed, based on the successive touch inputs that areapplied to the first graphic image and are moved.

The controller 180 controls the display unit 151 so that the constituentelements of the text corresponding to the first and second graphicimages 611 and 612 are changed in arrangement and are output, based onthe first and second graphic images 611 and 612 that are changed inarrangement. That is, when the first and second graphic images 611 and612 are arranged in this sequence, the changed text 710 a is output as“I'll get there by bus from here.” That is, the user can change theorder of the sentence construction that results in the text, by changingthe arrangement of the graphic images.

A control method of canceling the sentence construction according to thedeletion of the icon is described referring to FIG. 6D(a) to 6D(c).Referring to FIG. 6D(a), the text 720 is output to the display unit,based on the touch input applied to the first to fifth graphic images611 to 615 included in the icon 610.

The controller 180 controls the display unit 151 so that a deletion mark610′ for limiting the outputting of each graphic image is output, basedon the touch input that is applied to the icon 610. The controller 180controls the display unit 151 so that the outputting of the graphicimage is limited, based on the touch input that is applied to thedeletion mark 610′.

In addition, the controller 180 controls the display unit 151 so thatthe constituent element of the text corresponding to the graphic imageis deleted by applying the touch input to the deletion mark 610′.

The deletion mark 610′ is created so that it is superimposed on eachgraphic image, and thus limits the outputting of each graphic image andthe text corresponding to each graphic image. Alternatively, thedeletion mark 610′ is created on the icon 610 that includes the multiplegraphic images, so that the multiple graphic images can be deleted at atime and all the text can be deleted.

Accordingly, the user can delete the constituent units that make up thetext, by deleting the graphic image.

In addition, the fifth image 615 is created so that the control commandfor adding the graphic image for outputting a different predictedresponse is applied to the fifth image 615.

Although not specifically illustrated in the drawings, the controller180 controls the display unit 151 so that the graphic imagescorresponding to the predicted text are output according to apredetermined standard, based on the touch input that is applied to thefifth graphic image 615.

For example, the controller lines up the corresponding graphic images inthe increasing order of the likelihood that the constituent unit willbecome the constituent unit of the text for the response. Then, thecontroller sequentially outputs the corresponding graphic images, basedon the touch input that is applied to the fifth icon 615. In addition,the controller 180 controls the display unit in such manner that atleast one of the graphic images that correspond to the constituent unitsof the predicted text, respectively, is output and the graphic image isadded according to user's selection, based on the touch input that isapplied to the fifth graphic image 615.

According to the present embodiment, the unnecessary constituent unit ofthe text is deleted by deleting the graphic image, the outputting of theunnecessary graphic image is limited, and the graphic imagecorresponding to the necessary component is added. Therefore, the usercan output more conveniently the text that includes more variousconstituent units.

FIGS. 7(a) 7(c) is diagrams for describing a control method ofoutputting the text according to another embodiment.

Referring to FIGS. 7(a) to 7(c), a control method is described in whichthe text is output based on analysis of the content included in thescreen information is described. Referring to FIG. 7(a), the displayunit outputs the execution screen that includes a message that isreceived in the message application. The execution screen includes thefirst content 510 that is a message that is received, second content 510a that is a representative name of an external terminal, and thirdcontent 510 b that is a message that is previously transmitted from themobile terminal to the external terminal.

The controller 180 controls the display unit 151 so that the icon 610 isoutput as a result of analyzing the first content 510 and the text isoutput as a result of analyzing the second content 510 a and the thirdcontent 510 b, based on the touch input that is applied to the icon 610.For example, the controller selectively outputs a closing constituentunit of the text through the use of the second content 510 a and thethird content 510 b.

The content 510 a represents a sender who transmits the message and alsoa recipient to whom the user transmits the text, the controller searchesfor information related to the content 510 a stored in the memory 160 ofthe mobile terminal. For example, the related information is stored inany one of a server, the memory 160, and a memory space for anapplication. The related information may be information that includes arepresentative name of the external terminal.

In addition, the third content 510 b corresponds to the text that istransmitted by the user of the external terminal.

The controller determines the proper closing constituent unit for theuser of the external terminal, based on the information related to thecontent 510 a and the different text transmitted by the user. Forexample, if the closing constituent unit of the message that the usertransmits to the external mobile terminal is a term of respect, thecontroller uses as the term of respect the closing constituent unit ofthe text that is generated by the touch input that is applied to theicon 610.

Referring to FIGS. 7(b) and 7(c), the closing constituent unit of thethird content 510 b corresponds to the term of respect, and thecontroller 180 controls the display unit 151 so that text 730 includingthe closing constituent unit “I'll get there” is output, based on thetouch input that is applied to the icon 610.

The controller selects the closing constituent unit of the text, bycombining the multiple pieces of information that results from thecontent included in the screen information.

Accordingly, the user can be provided with the details of the text thatare selected. Furthermore, the user can be provided with more naturaltext because proper expressions are generated depending on how the textis practically used.

FIGS. 8A(a) to 8G(d) are diagrams for describing a control method ofoutputting information according to various embodiments.

A control method of outputting a current status of the user that resultsfrom analyzing the content is described referring to FIGS. 8A(a) to8A(c). Referring to FIGS. 8A(a) and 8A(b), the display unit includes thescreen information including the content 510, “How will you come here?”The screen information includes a status icon 620 “NOW” to which toapply the control command for detecting and outputting the currentstatus.

The controller detects the current status of the mobile terminal and thecurrent status of the user of the mobile terminal, based on the touchinput that is applied to the status icon 620. In addition, thecontroller extracts information related to the content 510 from thecurrent status detected.

For example, the controller extracts the user's moving route and movingstatus from the meaning of the semantic component “Will you come here?”in the content 510 and extracts the moving means from the meaning of thesemantic component “How.” Accordingly, the controller 180 controls thedisplay unit 151 so that the moving status at the current location andthe moving method are output. For example, the display unit outputs text750 expressing the current status “I got on the bus No. 401 at the SUSEOstation. I am stuck in a traffic jam.”

Accordingly, the user can output information related to the user'scurrent status corresponding to the content, based on the controlcommand that is applied to the icon.

A control method of selecting and outputting the constituent unit of thetext that corresponding to one graphic image is described referring toFIGS. 8B(a) to 8B(d).

Referring to FIGS. 8B(a) and 8B(b), the display unit outputs the content510 and the icon 610. First text 710 is output based on the firstgraphic image 611.

The controller 180 controls the display unit 151 so that a textselection section 630 is output, based on the touch input that isapplied to the second graphic image 612. The text selection section 630includes first and second constituent units 631 and 632.

Referring to FIG. 8B(c), the second constituent unit 632 is displayed as“search for current location.” If the touch input is applied to thesecond constituent unit 632, the controller searches for a currentlocation of the mobile terminal. For example, the controller detects thecurrent location of the mobile terminal using a GPS receiver andconverts the result of the detection into semantic components. Forexample, the location that is converted into the semantic componentscorresponds to an address, a famous place in the vicinity, a specificlocation that is set by the user, and the like.

When the current location is detected as an area near a gas station, thecontroller 180 controls the display unit 151 so that text 710 c to whichthe semantic component “near a gas station” 715 is added is output.

On the other hand, referring to FIG. 8B(d), the controller 180 controlsthe display unit 151 so that the text 710 c to which a semanticcomponent “from here” is added is output, based on the touch input thatis applied to the first constituent unit 631.

That is, multiple different blocks of text are provided for one graphicimage and the user can selectively output the text.

A control method of outputting the text related to the sequential piecesof information is described referring to FIG. 8C(a) to 8C(d). Referringto FIG. 8C(a), the screen information including content 520, “Where willwe eat a food?,” is output.

The controller analyzes the content 520. For example, informationrelated to the location, which results from a semantic component “Wherewill” and information related to the restaurant, which results from asemantic component “we eat?” are combined to provide the informationrelated to the content 520. As illustrated in FIG. 8C(c), the controller180 controls the display unit 151 so that information window 810including pieces of information generated by the content is output.

The information window 810 includes information related to the locationand information related to the restaurant, for example pieces ofinformation related to delicious-food restaurant, in the neighborhood,transportation, Korean food, Chinese food, recent event, and others. Theuser can apply the touch input to each piece of information to selectit.

Referring to FIG. 8C(c), the controller 180 controls the display unit151 so that low-level information 811 is output, based on the touchinput that is applied to the information window 810. For example, thecontroller provides at least one piece of low-level information relatedto restaurants in the neighborhood, based on the touch input that isapplied to “in the neighborhood.”

The controller outputs text 750 a, based on the touch input that isapplied to the low-level information. According to the presentembodiment, among the pieces of information, the controller convertsinto semantic components the information to which the touch input isapplied and outputs the result of the conversion as constituent units ofthe text. The controller 180 controls the display unit 151 so that thetext 750 a, “Let's eat at restaurant A,” is output, based on the Arestaurant to which the touch input is applied and on the content 520.

On the other hand, referring to FIG. 8C(d), the controller creates thetext, based on the touch input that is applied to the first informationwindow 810 and the low-level information window 811. That is, thecontroller 180 controls the display unit 151 so that the result ofapplying the touch input to the first information window 810 to outputthe low-level information window 811 is converted into the informationor the semantic component and is output as the constituent unit of thetext.

That is, the controller 180 controls the display unit 151 so that thetext “Let's eat at restaurant A in the neighborhood” is output includingas the constituent unit of the text the information (A restaurant, Brestaurant, and C restaurant) “in the neighborhood” for outputting theinformation related to the restaurant.

Accordingly, the user can generate the text using the information thatis provided in stages according to the analysis of the content.

A control method of providing multiple selectable items in the samecategory with respect to the analyzed content described referring toFIGS. 8D(a) to 8D(d). The controller analyzes the content 524 andcontrols the display unit 151 so that the second information window 821is output.

For example, the controller 180 controls the display unit 151 so thaticons that correspond to multiple movies and to which the touch input isapplied to output the multiple movies are output, using the movieincluded in the content 524 and a semantic component “How about watchinga movie?” Movie information included in the second information window821 is limited to the movie that is now on show. The icon correspondingto each of the movies is displayed as an image representing the movie, amovie poster, or the like, but is not limited to these.

The controller 180 controls the display unit 151 so that text, whichcorresponds to the movie and the semantic component “How about watchinga movie?” are output, based on the user's touch input.

Referring to FIG. 8D(c), the controller analyzes content 532 that isadditionally received from the external terminal and controls thedisplay unit 151 so that a third information window 822 including anicon corresponding to a theater is output.

That is, if the selectable information within substantially the samecategory, which results from the analyzed content, is predicted, thecontroller 180 controls the display unit 151 so that the iconcorresponding to each piece of information is output.

On the other hand, the controller 180 controls the display unit 151 sothat the information corresponding to the icon is converted into textand the image corresponding to the information is output, based on thetouch input that is applied to the icon.

A control method of outputting the image corresponding to the text thatis output based on the touch input applied to the icon is describedreferring to FIG. 8E(a) to 8E(d).

The controller analyzes the content 510 and controls the display unit151 so that the icon 610 is output. The control unit controls thedisplay unit 151 so that the text 720 is output, based on the touchinput that is applied to the icon 610.

Referring to FIGS. 8E(b) and 8E(c), the controller 180 controls thedisplay unit 151 so that the image associated with the text is output,based on the control command that is applied to the text 720 that isinput into the window.

For example, if the text 720 is “I got on the bus No. 508 at the GASANstation and am on my way home, but it will take a longer time due to arain-caused traffic jam,” images for the current location of the mobileterminal, the moving route, the weather, and so on are output.

As illustrated in FIG. 8E(c), the controller 180 controls the displayunit 151 so that a running course of the bus and a road view of a placewhere the mobile terminal is located are output.

Although not specifically illustrated, the controller 180 controls thedisplay unit 151 so that an image 720′ corresponding to a word or asemantic component in the text, to which the touch input is applied isoutput. That is, the controller categorizes into semantic componentunits the text that is input into the input window and controls thedisplay unit 151 so that the control command that is applied to thesemantic component unit is detected.

The controller 180 controls the wireless communication unit 110 so thatthe image 720′ that is output on the display unit is transmitted to theexternal terminal.

A control method of outputting the text using data stored in the memory160 is described referring to FIGS. 8F(a) to 8F(e).

Referring to FIG. 8F(a), the display unit outputs the screen informationincluding content 540. The controller extracts data related to theinformation including in the content 540 from the memory 160. Forexample, the content 540 includes a representative name of the externalterminal, and the controller extracts data including the representativename and data that is transmitted to and is received from the externalterminal, from the memory 160.

The controller 180 controls the display unit 151 so that a fourthinformation window 820 including data related to content stored in thememory 160 is output. The data corresponds to text, an image, a movingimage, and the like.

According to one embodiment, the controller lines up and outputs thedata according to a predetermined standard. For example, the controllerlines up and outputs the data in chronological order in which the datais stored in the memory or in order of the number of times that the samedata is output. The controller 180 controls the display unit 151 so thataccording to the predetermined standard, the data is changed in size andis output.

For example, the controller 180 analyzes a name MN JUNG and a present inthe content and controls the display unit 151 so that the data having arepresentative name, MN JUNG is extracted from the memory 160 and isdisplayed.

That is, the user can be provided with the data without having toremember that it is stored in the memory and then to search for it.

In addition, referring to FIG. 8F(c), the controller 180 controls thedisplay unit 151 so that data lower in level than the data included inthe fourth information window 820 is output, based on the touch inputthat is applied to the fourth information window 820.

Although not specifically illustrated in the drawings, the controller180 controls the display unit 151 so that an execution screen of anapplication including the selected data is output. For example, thecontroller 180 controls the display unit 151 so that the executionscreen of the message application outputting the messages transmitted toand received from the external terminal is output.

In addition, referring to FIG. 8F(d), the controller 180 controls thedisplay unit 151 so that the result of performing a search function withrespect to the selected data is output.

In addition, the controller 180 controls the display unit 151 so thatthe text is output, based on the touch input of the data according tothe result of the search and on details of the content of the screeninformation that is output on the display unit.

That is, the user can be provided rightly with the data, withoutdisplaying the execution screen of the application for executing adifferent function in order to be provided with the data. Additionally,the user can be provided not only with the data stored in the mobileterminal, but can be automatically provided also with the external data.Thus, it is possible to input text in a more convenient manner.

A method of controlling an additional function using the text that isoutput is described referring to FIG. 8G(a) to 8G(d).

Referring to FIG. 8G(a), the display unit outputs the screen informationincluding the content 520 and text 751. The controller 180 controls thedisplay unit 151 so that a fifth information window 751′ that isselectable is output, based on the control command that is applied tothe text 751.

For example, the fifth information window 751′ is created 151 so thatthe control command for executing the additional function associatedwith the text 751 or outputting the additional information is applied tothe fifth information window 751′. The fifth information window 751′includes a graphic image for outputting a location of the A restaurantand a graphic image for outputting a telephone number for making areservation for a meal at the A restaurant. The two graphic images comefrom the text 751. The controller analyzes the details of the text 751and generates the information for the fifth information window 751′.

For example, the controller outputs the location and the graphic imagefor controlling a reservation function through the meaning of theconstituent units of the text “restaurant” and “Let's go.” For example,if the text is “movie” the controller 180 controls the display unit 151so that the graphic image to which the control command is applied isoutput to make a reservation for the movie or to output a location oftheater.

Referring to FIG. 8G(c), the controller 180 controls the display unit151 so that a map image 752 showing the location of the A restaurant isoutput, based on the touch input that is applied to the location. Thatis, the controller 180 controls the display unit 151 so that thelocation of the A restaurant is searched for and the searched-for mapimage 752 is output, based on the control command that is applied to thelocation.

Referring to FIG. 8G(d), the controller 180 controls the display unit151 so that the telephone number of the A restaurant is searched for andthe searched-for telephone number is output, based on the touch inputthat is applied to the reservation. However, the manner in which thecontroller 180 controls the display unit is not limited to all of this.The controller may control the display unit 151 so that a web page forreservation is provided or a telephone call application is executed.

FIGS. 9A(a) to 9F(d) are diagrams for describing a control method ofcooperating with a different application using content according tovarious embodiments.

A control method of executing an application including data related tocontent is described referring to FIGS. 9A(a) to 9A(d). Referring FIG.9A(a), the execution screen of the message application, which includesthe messages transmitted to and received from the external terminal isoutput to the display unit.

For example, the screen information includes the text that istransmitted to and is received from the external terminal having therepresentative name “KIM MIN JUNG” The screen information includes thetext including semantic components, such as “present,” “I want to have aflower,” and the like.

Referring to FIG. 9A(b), the display outputs the execution screen of themessage application that causes the message transmitted from theexternal terminal representatively named KIM YOUNG SU to be included inthe content 540.

Referring to FIGS. 9A(b) and 9A(c), the content 540 includes a sentence“What should I buy for MN JUNG?,” and the controller outputs an icon 622corresponding to information extracted from the memory space for theapplication, based on the information “What should I buy for MN JUNG?,”

For example, as described referring to FIG. 9A(a), using the semanticcomponent “MIN JUNG” the controller extracts the message received fromthe external terminal representatively named “KIM MN JUNG” from thememory space for the message application.

The controller outputs a graphic image which includes at least one of anicon showing the message application and the details of the message andthrough which the message extracted from the memory space can beselected by the user's touch input.

In addition, the information included in the icon is not limited totext. For example, the controller extracts an image corresponding to thetagged semantic component “MIN JUNG” from a memory space for a galleryapplication and controls the display unit 151 so that a graphic imageincluding the image is output.

The controller outputs the text 710 using the information extracted fromthe memory space for the application, based on the touch input that isapplied to the icon 622. For example, the controller 180 controls thedisplay unit 151 so that among semantic components in a text message, apredicted response is output, based on the touch input that is appliedto the graphic image corresponding to the text message. Referring toFIG. 9A(d), the controller 180 controls analyzes semantic components“kind of flower” and “I want to have” in the text message and controlsthe display unit 151 so that “kind of flower are output.

That is, the controller extracts the semantic components from the textmessage and outputs the display unit 151 so that the semantic componentcorresponding to the content 540 is output as text. Although notillustrated in the drawings, the semantic component extracted from thetext message and an additional semantic component as a responsecorresponding to the content 540 are output. For example, the controlleradds “How about” as a response to “What should I buy?” and controls thedisplay unit 151 so that the text “How about a kind of flower” isoutput.

Accordingly, the user can selectively output as text the informationstored in a memory space for each of the multiple application thatinclude the information corresponding to the content.

Referring to FIGS. 9B(a) to 9B(d), a control method is described inwhich the text is output based on the touch input that is applied to asixth information window 830 that is stored in a memory space for adifferent application.

Referring to FIGS. 9A(a) and 9A(b), the controller 180 controls thedisplay unit 151 so that a sixth information window 830 including oneportion of the execution screen of the application is output, based onthe content.

For example, the controller 180 controls the display unit 151 so that anexecution of a calendar application is output, based on time included inthe content. In addition, the controller 180 controls the display unit151 so that the execution screen including the information related to aschedule for afternoon of Saturday that is already input, based on thesemantic components “Saturday,” and “afternoon.”

Although not illustrated in the drawing, the controller outputs thesixth information window 830, using the content included in the screeninformation, and current status information on the mobile terminal thatis detected. For example, if time information is included in the contentand data information is not present, information to be output to thesixth information window 830 is extracted using a current date.

Referring to FIGS. 9B(b) and 9B(c), the controller 180 controls thedisplay unit 151 so that text 780 corresponding to the screeninformation included in the sixth information window 830 is output,based on the touch that is applied to one region of the sixthinformation window 830.

For example, the sixth information window 830 includes multiple inputregions that are partitioned according to the passage of time, and thecontroller outputs time corresponding to the input region to the textaccording to one input region to which the touch input is applied.

For example, the controller generates a constituent unit of the text “atsix o'clock” based on the touch input that is applied to the inputregion corresponding to six o'clock. The controller outputs the textusing the information that is included in the execution screen of theapplication and that is selected by the user. Thus, the controllerprovides the information stored in the memory space for the applicationto the user and outputs directly the information as text.

Referring to FIGS. 9C(a) to 9C(d), a control method is described inwhich text is output based on the touch input that is applied to thesixth information window 830 stored in the memory space for theapplication according to another embodiment.

The controller 180 controls the display unit 151 so that the executionscreen of the calendar application, based on the content 550. Referringto FIG. 9C(b), the multiple input regions that result from thepartitioning by the touch input are selected.

The controller 180 controls generates text 781 using the touch inputthat is applied to the input regions, 12 o'clock and six o'clock, of theexecution of the application, and controls the display unit 151 so thatthe text 781 is output. For example, the text 781 corresponds to asentence “I am available from twelve o'clock to three o'clock or aftersix o'clock.”

Referring to FIGS. 9D(a) to 9D(d), a control method is described inwhich the multiple information windows, each including informationdifferent in category, are sequentially output in order to generate textusing content.

Referring to FIGS. 9D(a) to 9D(d), the controller 180 controls thedisplay unit 151 so that the sixth information window 830 including oneportion of the execution screen of the message application, based on thecontent 550. In addition, the controller 180 controls the display unit151 so that first text “See you at six o'clock” is output, based on thetouch input that is applied to one region of the sixth informationwindow 830.

In a state where the first text is output, the controller 180 controlsthe display unit 151 so that a seventh information window 831 is output,based on the content 550 according to the application of a predeterminedcontrol command or the passage of predetermined time (several seconds).For example, the seventh information window 831 includes pieces ofinformation related to appointed time, such as place information, timeinformation, and situation information.

The controller 180 controls the display unit 151 so that low-levelpieces of information of each of the pieces of information describedabove are output, based on the touch input that is applied to theseventh information window 831. For example, icons associated with theplace that is predicted as being input by the user are output, based onthe touch input that is applied to the place.

The controller 180 controls the display unit 151 so that text is createdand is output, based on the touch input that is applied to the icon.

Referring to FIGS. 9E(a) to 9E(d), a control method is described inwhich text is created based on the touch input that is applied to thecalendar application. Referring to FIG. 9E(a), the controller 180controls the display unit 151 so that the execution screen of thecalendar application is output according to the content 551.

The controller outputs the execution screen of the calendar applicationdisplaying a date using a sentence that is made from “When” and “will wemeet?” included in the content 551, but is not limited to that executionscreen. That is, a different screen information including informationcorresponding to “When” may be output.

The controller 180 controls the display unit 151 so that text 783 isgenerated and is output, based on the touch input that is applied to atleast one date included in an execution screen 640 of the calendarapplication.

A control method of performing the search function with respect to anicon and thus creating text is described referring to FIGS. 9F(a) to9F(d). Referring to FIG. 9F(a), the controller outputs an icon includingmultiple graphic images, based on the content 520. The controller 180controls the display unit 151 so that a different low-level icon 530 isoutput, based on the touch input that is applied to one graphic image.

For example, the controller 180 controls the display unit 151 so thatlow-level icons 630 including the multiple graphic images, each showingan adjacent restaurant, are output, based on the touch input that isapplied to the graphic image corresponding to a location search. Thatis, the controller collects and extracts information related to theadjacent restaurant and provides the extracted information.

In addition, the controller 180 controls the display unit 151 so that asearch screen 631 that results from searching for the informationincluded in the low-level icon 630 is output, based on the touch inputthat is applied to the low-level icon 630. The search screen 631includes information related to each restaurant (for example, thelocation, the menu, the restaurant assessment and the like).

The controller 180 controls the display unit 151 so that a low-levelicon 632 for the restaurant is output, based on the touch input that isapplied to any of the pieces of information included in the searchscreen 631. The controller 180 controls the display unit 151 so that thetext is output, based on the touch input that is applied to thelow-level icon 632.

According to the present embodiment, at least a low-level search processand a process of outputting the search screen are included in order tooutput the icon to which the touch input is applied to input the text.

In addition, the controller 180 controls the display unit 151 so thatthe information that is output to the search screen is created as textand is output.

Accordingly, the user can be conveniently provided with a lot ofinformation without separately executing a search application and outputthe piece of information as text.

FIGS. 10A(a) to 10E(d) are diagrams for describing a control method ofanalyzing an image and executing a prediction function.

A control method of detecting information included in an image andproviding a wireless signal to an external terminal is describedreferring to FIGS. 10A(a) to 10A(c). FIG. 10A(a) illustrates a screeninformation including content that is made from an image 560 and thescreen information corresponds to the execution of the galleryapplication.

The controller analyzes information included in the image 560. Forexample, if a photo of a person is included in the image 560, thecontroller searches for information related to the person, among piecesof information corresponding to an external terminal, which are storedin the mobile terminal, and provides the person-related information toan external terminal corresponding to the person-related information.

Referring to FIG. 10A(b), the controller outputs the execution screenfor sharing the content that is made from the image 560, and controlsthe display unit 151 so that an icon 640 including an image related tothe image 560 is output. For example, the icon 640 includes a photo thatincludes a person that is recognized as substantially the same person asat least one person included in the image 560, a photo of a personrelated to (for example, a person who is a friend of, or who has thesame group membership as) the person included in the image 560 in SNS,and information related to the group to which the person belongs.

The controller performs control so that the image 640 is shared, basedon the touch input that is applied to the icon 640. However, a functionis not limited to the sharing function, and a function of transmitting amessage and other functions are included.

Although not illustrated in the drawings, an image included in thescreen of the application in which the message is desired to betransmitted is analyzed, and information related to the image isprovided as text.

That is, bases on the analysis of the content that is made from theimage, the user can execute functions, such as sharing or transmittingthe content with or to the external terminal corresponding to theinformation related to the analysis of the content. Therefore, the usercan conveniently execute the function without having to search for theexternal terminal with which wireless communication is desired to beestablished.

Referring to FIGS. 10B(a) to 10B(d), a control method is described inwhich an icon that is made from an image is output based on content.

Referring to FIGS. 10B(a) and 10B(b), the controller 180 controls thedisplay unit 151 so that an icon 641 including a list for outputtingmultiple images and a different screen information is output, based oncontent 561. For example, the content corresponds to a sentence that ismade from semantic components such as “yesterday,” and “a photo that wastaken,” and the controller 180 controls the display unit 151 so thatphotos that were taken and stored are output. In addition, thecontroller 180 controls the display unit 151 so that a list to which acommand to execute an application through which to check the photos thatwere taken yesterday and stored is applied is output.

The controller 180 controls the display unit 151 so that the photo isoutput to the input window and text “I'll send you” corresponding to“Please send me” included in the content 561 is output together, basedon the touch input that is applied to the photo (image) included in theicon 641.

That is, the user can be provided not only with the text that ispredicted through the use of the content, but also with the image(including a moving image file and the like) that can be transmitted.Thus, the user can transmit the messages and the like more conveniently.

A control method of selecting at least one image among multiple imagesthat are output through the use of content is described referring toFIGS. 10C(a) to 10C(d).

Referring to FIGS. 10C(a) and 10(b), the controller 180 controls thedisplay unit 151 so that an icon 642 including the photos that weretaken yesterday is output through the user of the content.

Referring to FIG. 10C(c), the controller 180 controls the display unit151 so that the photo selected from among the photos described above isdisplayed as highlighted. For example, the selected photo is output aschanged in size, or is output with the edge highlighted, or is output aschanged in brightness and saturation.

The controller 180 controls the display unit 151 so that the multiplephotos are selected and are selected as highlighted, based on themultiple touch inputs that are applied to the icon 642.

If at least one photo is selected, the controller 180 controls thedisplay unit 151 so that at least the selected one photo is transmittedto a predetermined external terminal, based on the touch input that isapplied to the graphic image through which transmission of a message iscontrolled.

However, a function is not limited to this function. When the differenttouch input is applied to at least the selected one photo, thecontroller may control the display unit 151 so that the photo isdisplayed on the input window.

A control method of providing as an image a result of the search that isbased on content is described referring to FIGS. 10D(a) to 10D(c).Referring to FIGS. 10D(a) to 10D(b), the control unit searches forinformation related to content 571. For example, if the content 571includes a sentence “Where is your house located?” the controllersearches for information related to a location of the house.

The controller 180 controls the display unit 151 so that imageinformation related to the location of the house is output. Therefore,the user can transmit check the image related to the location of thehouse and then transmit it to the external terminal.

A control method of providing multiple pieces of information that aresearched for, based on content is described referring to FIG. 10E(a) to10E(d).

Referring to FIGS. 10E(a) and 10E(b), the controller 180 controls thedisplay unit 151 so that an icon 850 including first search information851 and second search information 852 that are searched for, based oncontent 570 is output.

For example, when the content includes a semantic unit “JUN's phonenumber,” the controller searches the memory 160 for information usingthe words. The controller creates phone information on a portableterminal, which includes a representative name “JUN,” and home phonenumber information, which includes the representative name “JUN,” as thefirst search information 851 and the second search information 852 andoutputs them.

The controller transmits at least one piece of information among thefirst search information 851 and the second search information 852 tothe external terminal, based on the touch input that is applied to theicon 850.

The controller 180 controls the display unit 151 so that the result ofthe search including the phone number information is created as text andis output. For example, when the text “JUN's PHONE” is output and thetouch input is applied to “JUN's PHONE,” the controller 180 performscontrol so that the text is transmitted with information related to thephone number included.

The controller 180 controls the display unit 151 so that the textcorresponding to the first search information 851 and the second searchinformation 852 are output to the input window, based on the touch inputthat is applied to all of the first search information 851 and thesecond search information 852.

Although not illustrated in the drawings, the controller performscontrol so that the result of the search, as is, is output on thedisplay unit.

FIGS. 11A to 11C are diagrams for describing a control method ofproviding an icon including multiple graphic images. Referring to FIGS.11A and 11B, the controller outputs the icon 610 including the multiplegraphic images, based on the content.

The controller 180 controls the display unit 151 so that the icon 610 isoutput including different graphic images, based on the touch inputaccording to a predetermined method, which is applied to the icon 610.

It is preferable that the touch input be distinguished from a touchinput through which to select one graphic image. For example, the touchinput according to the predetermined method corresponds to a touch inputaccording to a dragging method, in which the selected icon iscontinuously dragged in one direction.

The controller 180 controls the display unit 151 so that one portion orall portions of the graphic image included in the icon 610 is switchedto a different graphic image, based on the touch input. Here, thegraphic image corresponds to a graphic image including informationsubstantially related to the content.

Accordingly, the user can be provided more conveniently with variousgraphic images for outputting multiple pieces of information.

A control method of outputting multiple graphic images each of whichcorresponds to content and is included in the same category is describedreferring to FIGS. 12A(a) to 12A(c) and FIGS. 12B(a) to 12B(d).

Referring to FIGS. 12A(a) and 23A(b), the controller 180 controls thedisplay unit 151 so that multiple graphic image 650 are output as aresponse corresponding to content 580 including a semantic component“Good night.”

The graphic image corresponds to the response to the content 580. Thegraphic image 650 is made from various types of information such asletters, images, and moving images.

The controller 180 performs control so that the graphic image 650corresponding to a predetermined semantic component (or an image andothers) that makes up the content 650 is stored in the memory 160.Information included in the graphic image 650 is created based on arecording that is stored or output by the user.

For example, the controller 180 controls the display unit 151 so thatthe multiple graphic images corresponding to the content 650 are outputin order of frequency in use or in order that is predetermined by theuser.

Accordingly, if the user desires to transmit repetitive responses to thecontent, he/she can do this more handily.

Referring to FIGS. 12B(a) to 12B(d), a control method is described inwhich a graphic image including pieces of information that aresubstantially the same type is output based on content.

Referring to FIGS. 12B(a) and 12B(b), the controller 180 controls thedisplay unit 151 so that an icon 660 that is made from multiple graphicimages including different emoticons related to a feeling is output,based on content including a sentence “How do you feel?” The emoticon iscreated in the shape of a human face expressing different feelings.

The controller 180 controls the display unit 151 so that text expressingthe emoticon is output, based on the control command that is applied toone graphic image. For example, the controller 180 controls the displayunit 151 so that text “I am angry,” is output, based on the touch inputthat is applied to one graphic image.

Accordingly, the user can prepare more handily for the responses to thetext, which has a different meaning and are in substantially the sameemotion category.

The configuration and the method relating to the mobile terminal and themobile terminal equipped with a cover described above according to theembodiments are not applied in a limiting manner, but all of or some ofthe embodiments may be selectively combined with each other to createvarious modifications to the embodiments.

The foregoing embodiments and advantages are merely exemplary and arenot to be considered as limiting the present disclosure. The presentteachings can be readily applied to other types of apparatuses. Thisdescription is intended to be illustrative, and not to limit the scopeof the claims. Many alternatives, modifications, and variations will beapparent to those skilled in the art. The features, structures, methods,and other characteristics of the exemplary embodiments described hereinmay be combined in various ways to obtain additional and/or alternativeexemplary embodiments.

As the present features may be embodied in several forms withoutdeparting from the characteristics thereof, it should also be understoodthat the above-described embodiments are not limited by any of thedetails of the foregoing description, unless otherwise specified, butrather should be considered broadly within its scope as defined in theappended claims, and therefore all changes and modifications that fallwithin the metes and bounds of the claims, or equivalents of such metesand bounds are therefore intended to be embraced by the appended claims.

What is claimed is:
 1. A mobile terminal comprising: a wirelesscommunication processor configured to receive message from an externalterminal; a touch screen; and a controller configured to: cause thetouch screen to display an execution screen of a message applicationcomprising a received message from the external terminal via thewireless communication processor, analyze a meaning of the receivedmessage and one or more constituent units of the received message,wherein the one or more constituent units comprises at least one of asubject, an object, a verb, and an adverbial phrase, predict at leastone response to the received message based on the meaning of thereceived message and the one or more constituent units, display, on thetouch screen, at least one icon corresponding to the at least onepredicted response, display a first text portion as a part of a responsemessage to the received message, in response to a touch input on the atleast one icon, wherein a meaning of the first text portion correspondsto a predicted response corresponding to the at least one icon, displaya second text portion as a remaining part of the response message, andtransmit, via the wireless communication processor, the response messageto the external terminal, wherein constituent units of the first textportion and the second text portion correspond to the analyzed one ormore constituent units of the received message.
 2. The mobile terminalof claim 1, further comprising a memory configured to store datatransmitted and received from the external terminal.
 3. The mobileterminal of claim 2, wherein the at least one icon includes a pluralityof graphic images, and wherein each respective graphic image includesdata different from data included with any other graphic image among theplurality of graphic images.
 4. The mobile terminal of claim 3, whereineach respective graphic image includes multiple pieces of information,and wherein the controller is further configured to output the multiplepieces of information.
 5. The mobile terminal of claim 3, wherein thecontroller is further configured to output, based on the touch input, atleast one portion of text based on the multiple pieces of information.6. The mobile terminal of claim 5, wherein the at least one portion oftext based on the touch input is responsive to the content.
 7. Themobile terminal of claim 6, wherein the at least one portion of text isrelated to the graphic image.
 8. The mobile terminal of claim 7, whereinthe controller is configured to receive multiple touch inputs, eachtouch input applied to a different graphic image.
 9. The mobile terminalof claim 8, wherein, responsive to each touch input applied, thecontroller is further configured to output a portion of text differentfrom portions of text output responsive to any other touch input. 10.The mobile terminal of claim 3, wherein a combination of the respectiveportions of text is responsive to the content.
 11. The mobile terminalof claim 5, wherein the at least one portion of text based on the touchinput is further based on current terminal information regarding themobile terminal.
 12. The mobile terminal of claim 11, wherein thecurrent terminal information is location information.
 13. The mobileterminal of claim 2, wherein the controller is further configured todisplay a search icon that includes a search window containinginformation to be searched, based on the content.
 14. The mobileterminal of claim 13, wherein the controller is further configured toexecute a search for information related to the content, responsive tothe touch input.
 15. The mobile terminal of claim 14, wherein thecontroller is further configured to output a search result responsive tothe search for information related to the content.
 16. A method ofgenerating text in response to a content in a mobile terminal, themethod comprising: receiving a message from an external terminal;displaying, on a touch screen, an execution screen of a messageapplication comprising a received message from the external terminal viaa wireless communication processor; analyzing a meaning of the receivedmessage and one or more constituent units of the received message,wherein the one or more constituent units comprises at least one of asubject, an object, a verb, and an adverbial phrase; predicting at leastone response to the received message based on the meaning of thereceived message and the one or more constituent units; displaying, onthe touch screen, at least one icon corresponding to the at least onepredicted response; displaying, on the touch screen, a first textportion as a part of a response message to the received message, inresponse to a touch input on an icon among the at least one icon,wherein a meaning of the first text portion corresponds to a predictedresponse corresponding to the icon; displaying, on the touch screen, asecond text portion as a remaining part of the response message; andtransmitting, via the wireless communication processor, the responsemessage to the external terminal, wherein constituent units of the firsttext portion and the second text portion correspond to the analyzed oneor more constituent units of the received message.
 17. The method ofclaim 16, wherein each respective icon includes at least one graphic andeach graphic is based on at least one semantic component of therespective constituent unit.
 18. The method of claim 17, wherein thetext information is text responsive to the content.
 19. The mobileterminal of claim 1, wherein the controller is further configured to:change an arrangement of the displayed text based on an arrangement ofthe at least one icon; and transmit the text to the external terminalwhen a touch input is applied to a preset image displayed with the text.